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Path  algebra  computations  are  required  for  the  solution  of  numerous  prob¬ 
lems  of  practical  interest,  see  (GMj,  (TJ.  In  particular  M.  Gondran  and  M.Minoux 
list  the  applications  of  path  algebras  to  the  problems  of:  vehicle  routing,  invest¬ 
ment  and  stock  control,  dynamic  programming  with  discrete  states  and  discrete 
time,  network  optimization,  artificial  intelligence  and  pattern  recognition, 
labyrinths  and  mathematical  games,  encoding  and  decoding  of  information,  (CM), 
pp.  41-42,  75-81.  There  is  an  effective  way  to  unify  such  computations  by  reduc¬ 
ing  them  to  certain  matrix  operations  over  a  dioid  where  ©  and  ^  are 

the  operations  of  that  dioid;  see  (GM|,  pp.  84-102.  The  following  classes  of  prob¬ 
lems  allow  that  reduction;  i)  existence  (problems  of  connectivity);  ii)  enumeration 
(elementary  paths,  multicriteria  problems,  generation  of  regular  languages);  iii) 
optimization  (paths  of  ma.vimum  capacity,  paths  with  minimum  number  of  arcs, 
shortest  paths,  longest  paths,  path  of  maximum  reliability,  reliability  of  a  net¬ 
work);  iv)  counting  (counting  of  paths,  Markov  chains);  v)  optimization  and 
post-optimization  (problems  of  k-th  path,  n-optimal  paths),  see  [GMj,  pp.  91,  94- 
102. 

Specifically,  the  above  computations  are  reduced  to  the  evaluation  (over  the 
dioid)  of  the  matrix  A*  (the  all  pair  path  problems)  or  of  the  vector  A*  b  (the 
single  source  path  problems)  where 

A*  =  A'"  ",  A<''+"  =  A<''>©  A'’+‘,q=0,l . =  A^’’'  if  q>n-l.  (1) 

A<«^  =  I  is  the  identity  matrix,  A  is  an  nXn  input  matrix,  b  is  a  fixed  coordinate 
vector  of  dimension  n,  (GMj,  sect.  3.2,  3.3.  Here  and  hereafter  we  as.sume  that  all 
computations,  in  particular  computing  the  powers  of  a  matrix,  are  performed 
over  the  dioid.  Then 

A*  =  I©A©A2@  •  •  •  ©A"'* 
so  A*  can  be  computed  as  follows, 

A*  =  (1  ©  A)  *  (I  ©  A^)  *  (I  ©  A<)  IK  •  •  •  (I  ©  A2‘),  k  =  r  logsn]  . 


This  requires  only  k-1  matrix  additions  and  2k-2  matrix  multiplications,  which 
means  a  total  of  n*(k-l)(4n-l)  operations  in  the  dioid.  (We  cannot  use  fast 
matrix  multiplication  algorithms  over  the  dioid.)  For  many  dioids  the  operation 
®  is  idempotent,  that  is,  a  O  a  =  a  for  all  a  6  S.  In  that  case 

A*  =  S  V  =  £  C{n,r)  =  (I  ©  A)"  =  (I  ©  xf 

r»0  r-0 

(where  denotes  a  sum  in  the  dioid,  C(n,r)  =  r!  /  n?(n-r)!,  k  =  f  )- 

A*  can  be  computed  via  repeated  squaring  of  I  ©  A.  Therefore  we  may  compute 
A*  using  only  k-1  matrix  multiplications  and  a  single  addition  of  the  two 
matrices  A  and  1,  that  is,  using  a  total  of  n“(k-l)(2n-l)+n  operations  in  a  dioid 
with  idempotent  ©.  It  is  easy  to  parallelize  these  two  known  algorithms,  which 
yields  rather  efficient  parallel  scheme  for  the  evaluation  of  A*  where  is  a  dense 
matrix.  If  A  is  sparse,  then  the  above  ways  are  relatively  less  effective  for  the 
sparsity  of  A  is  not  generally  preserved  during  the  computation. 

Computing  A*  JK  b  (the  single  source  path  problems),  can  be  reduced  to  the 

k 

n  successive  premultiplications  of  the  vectors  V  A'^b  by  the  matrix  A  for 

r-O 

k=0,I,...,n'l  (and  to  n-1  vector  additions  in  the  case  where  the  operation  ©  is 
not  idempotent  in  the  given  dioid),  that  is,  to  a  total  of  (2  D(A)  -  n)(n-l)  opera¬ 
tions  in  the  dioid  (or  of  2  D(A)(n-l)  operations  in  the  case  of  nonidempotent  ©). 
provided  that  the  operations  in  the  dioid  are  not  counted  if  at  lea.st  one  of  the 
operands  is  zero.  Here  D(A)  denotes  the  number  of  nonzero  entries  of  A.  Thi.s 
way  we  exploit  sparsity  of  A  to  some  extent;  note,  however,  that  the  above  esti- 
mates  translate  into  0(n  log  n)  parallel  steps  and  Dl.'X)  processors.  Here  and 
hereafter  we  assume  a  customary  machine  model  of  parallel  computation.  wlH're 
in  every  parallel  step  each  processor  performs  at  most  one  operation  of  the  con¬ 
sidered  type;  in  our  case  this  means  at  most  one  operation  of  the  dioid. 
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In  this  paper  we  will  consider  the  case  where  the  associated  graph 
G  =  (V,E)  of  the  input  matrix  has  an  s(n)-separator  family,  s(n)  =  n*^,  (t  <  1,  a 
is  sufficiently  small.  We  define  an  s(n)-separator  family  of  a  graph  following 
Definition  1.1  of  [PR],  that  is,  G  is  said  to  have  an  s(n)-separator  family  if,  by 
deleting  a  separator  set  S  of  vertices,  |  S  1  <  s(  |  V  j  ),  we  may  partition  G  into 
two  disconnected  subgraphs  with  the  vertex  sets  Vj  and  V2 
I  I  <  I  ^  I  '  >=1.2,  a  is  a  constant,  a  <  1;  furthermore  we  assume  that 
such  a  partition  can  be  recursively  extended  to  each  of  the  two  resulting  sub¬ 
graphs  of  G  defined  by  the  vertex  sets  S  U  V;,  i=l,2,  and  so  on.  Then  we  may 
further  reduce  the  computational  cost  of  computing  A‘  and  A*  51^  b  using  the 
nested  dissection  algorithms  of  [LRTl  for  the  sequential  computation  and  of  [F’Ff] 
for  the  parallel  computation. 

It  may  seem  that  we  need  to  have  a  symmetric  positive  definite  matrix  A  to 
apply  these  algorithms.  A  is  indeed  symmetric  in  the  case  of  paths  in  graphs; 
however,  even  when  we  deal  with  digraphs  and  nonsymmetric  A,  we  may  apply 


the  extension  of  the  algorithms  of  (PRj  to  the  nonsymmetric  case  following  [PRa]. 
for  instance,  we  may  reduce  the  solution  of  the  matrix  equation  Ax  =  b  with  a 
nonsymmetric  matrix  A  to  the  solution  of  the  matrix  equation  FI(r,x)^  =  (b.O)^ 


where  H  = 


O  A 

A'T  I 


or  H  = 


O  A 

at  o 


.  Here  and  hereafter  I,  W^.v^.O  and  © 


denote  the  identity  matrix,  the  transpose  of  a  matrix  W  and  of  a  vector  v.  the 
null  matrix  and  the  null  vector,  respectively.  On  the  other  hand,  it  can  be  shown 
tliat  the  algorithm  that  we  will  suggest  can  be  extended  to  the  case  of  nonsym¬ 
metric  systems  Ax  =  b  also,  as  long  as  a  family  of  s(m-t-n)-separators  is  known 
for  the  associated  graph  of  A. 

Another  apparent  difficulty  is  that  the  dioid  elements  may  have  no  inverses 
regarding  the  operations  ©  and  3K.  That  difficulty  is,  however,  resolved  due  to 
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tbe  generalized  Jordan  elimination  algorithm,  which  requires  only  the  operations 
©  and  JK,  see  (GM],  Section  3.4.3.  (The  algorithm  works  unless  generalized 
inverses  of  some  computed  values  do  not  exist  but  this  is  a  relatively  weak  res¬ 
triction.)  We  combine  that  algorithm  with  computing  a  recursive  factorization  of 
Section  4  of  [PR]  for  the  matrix  Ao  =  PAP*^  where  P  is  a  permutation  matrix 
obtained  in  the  process  of  computing  that  recursive  factorization.  In  [PR]  the 
recursive  factorization  of  Ao  is  defined  by  the  following  matrix  and  block-matrix 
equations  where  h=0,l,...,d-l,  d=0(log  n), 

Ah  =  Y^j,  Zh  ’  =  Ah+i  + 

_  [  I  M  ® 

YhXh*  I  0  Ah+,  0  I 

1  -Xh'Yh'r  Xh‘  0  1  0 

I  0  Ah|,J  -YhXh'  1  • 

Computing  over  dioids  we  should  replace  the  inverse  W"'  of  every  matrix  W  with 
its  generalized  inverse  W*  and  either  dispense  with  the  signs  -  or  replace  them 
with  ©.  Then  we  would  arrive  at  the  following  recursive  factorization  that  we 
will  substantiate  below. 


A,  = 


Y  "V" 

Av,  1  k 


Y  ’Ah+J  —  Zh  @  ^  h^h^  h  > 


Ak  = 


Ak*  = 


1  O 
YhXh*  I 
x;yJ 
O  I 


Xh  O 
O  Ah+1 

Xh*  o  ■ 
o  AhV, 


I  Xh'Yh'^ 
O  I 

I  o’ 
VhXh*  I 


h=0,l,...,d-l.  We  should  verify  that  (2)  and  (3)  indeed  define  the  generalized 
inverse  of  A  over  the  given  dioid.  To  do  that,  we  apply  the  generalized  Jordan 
algorithm  to  the  2X2  block  matrices  Aj,  of  (2),  which  have  decreasing  sizes  as  h 
grows  from  0  to  d-1.  The  proof  of  Theorem  4.3.6,  (GM),  pp.  108-110.  and  conse- 
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quently  of  the  equations  (4.3.1)  and  of  the  subsequent  equations  on  p.  16  of  [GM] 
are  easily  extended  to  the  case  of  block-matrices.  These  equations  for  the  case 
N=2  immediately  imply  the  validity  of  (2)  and  (3).  (Expand  (3)  and  adjust  the 
notation  of  [GM],  p.  110.) 

It  remains  to  estimate  the  number  of  operations  in  the  dioid  required  in 
order  to  compute  A*b  using  the  recursive  factorization  (2),  (3).  We  proceed  simi¬ 
larly  to  deriving  the  estimates  for  the  recursive  factorization  in  [PR],  noting  that 
for  some  au.viliary  s(o^n)  Xs(a*'n)  block-matrices  B,  (where 
a  <  1  h=k,k-l,...,0,  k=0(log  n)),  we  need  to  compute  B‘v,v  being  a  fixed  vec¬ 
tor,  B*  being  defined  by  (1)  where  B*  and  B  substitute  for  A*  and  A,  respectively. 
It  is  easy  to  extend  the  assumed  property  that  =  A^'^)  for  q  >  n-1  to  the 

equations  B*'*'*’*)  =  B^**)  for  q  >  s(a^n)'-l  for  A  and  B  are  associated  with  the 
path  problems  of  same  kind,  having  only  different  sizes  n  and  s(o^n).  respectively. 
Similarly  to  [PR],  for  the  evaluation  of  B*  given  B,  we  apply  the  cited  earlier 
algorithms  for  the  dense  matrix  case.  These  algorithms  require 
s*(4s-l)  (  f  logos”)  -1)  operations  in  the  dioid  where  s=s(Q*'n).  Applying  parallel¬ 
ization  we  arrive  at  the  favorable  complexity  bounds  of  0(log  n  log"s(n))  parallel 
steps  and  j  E  |  -f  s^(n)/log  s(n)  processors  for  computing  the  recursive  factoriza¬ 
tion  of  A*  and  0(log  n  log  s(n))  parallel  steps  and  j  E  ]  -t-s‘(n)  processors  for  com¬ 
puting  A*b  for  every  b  where  the  recursive  factorization  of  A*  is  available.  Here 
|E|  denotes  the  number  of  edges  of  the  graph  associated  with  the  matrix  .A.  1  tus 
gives  algorithms  for  both  single  source  path  problems  (where  b  is  fixed)  and  all 
pair  path  problem  (where  we  may  Just  perform  the  evaluation  for  all  the  n  coor¬ 
dinate  vectors  b).  Comparison  of  the  latter  estimates  with  the  estimates  for  the 
cost  of  the  straightforward  algorithms  for  computing  A*  and  A*b,  which  we 
recalled  earlier,  shows  that  our  extension  of  the  nested  dissection  algorithm  of 
[PR]  substantially  accelerates  the  solution  of  both  single  source  and  all  pair  path 
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problem. 

The  authors  thank  Sally  Goodall  for  typing  this  paper. 
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